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Abstract 

In spite of all the interest and importance of complexity, this concept remains elusive. In particular, several attempts 
at defining and/or quantifying complexity have, at some point, run into intrinsic difficulties. This didactic text provides 
a brief review of some of the approaches that have been used to characterize complexity, and also suggests a possible 
definition of complexity based on the cost assigned to mapping the entity of interest, as well as on the cost of the error 
implied by its respective reconstruction. 


‘Mai l’ingegno umano trovera invenzione piu bella lie pm facile 
ne piu breve della natura, perche nelle sue invenzioni nulla 
manca e nulla e superfluo.’ 

Leonardo da Vinci. 


1 Introduction 

One of the terms that has become particularly common 
in science is complexity. Though we have an intuitive un¬ 
derstanding of this concept, to the point of being able 
to typically recognizing if something is complex or not, it 
turns out that it is particularly difficult to define complex¬ 
ity (e.g. Qj.lE]). In other words, complexity is complex. 
Indeed, several of the approaches that have been proposed 
for defining and better understanding complexity sooner 
or later run into intrinsic difficulties. For instance, we can 
attempt to define the the complexity of a given text as the 
number of words it contains. While such an attempt may 
seem reasonable at first, it soon occurs to us that it is not 
only the number of words contained in a text that mat¬ 
ters, but also the own meaning of the words, as well as 
their interrelationships. In fact, a text containing one mil¬ 
lion times the word ‘hello’ cannot be said to be complex, 
being instead very simple. In spite of its simplicity, this 
example already illustrates an approach that has become 
frequent while dealing with complexity, namely consid¬ 
ering the minimal length of the description of the entity 
whose complexity is to be gauged. In this particular case, 
the text with a million words can be very compactly de¬ 


scribed, not surprisingly, as a text with a million ‘helloes’. 


a text with 
a million "helloes" 


OBJECT DESCRIPTION 

Figure 1: The size of an entity is one of the most intuitive attempts at 
measuring complexity. However, this concept may run into difficulties, 
such as in the case of a text containing a million repetitions of the word 
‘hello’. Despite its large size, this emphatically welcoming text is by 
every means very simple, being describable by a simple sentence. Ob¬ 
serve that the quantification of complexity often involves the mapping of 
an entity from one space (typically nature) into another (e.g. language, 
logic and/or mathematics). 



The frequent conceptualization of complexity in terms 
of the concept of description reveals a close relationship 
between complexity and scientific modeling. As a mat¬ 
ter of fact, accurately describing a phenomenon consists 
in one of the main objectives of modeling. Another im¬ 
portant one is to provide subsidies for making predictions 
about the observed phenomenon. As commonly known, 
predictions are intrinsically associated to respective er¬ 
rors. Such modelings implies mapping the real world into 
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a relatively precise and formal system of representations, 
such as natural language and/or logics and/or mathemat¬ 
ics. In the aforementioned example, we are mapping a 
text from the real world into a short sentence of the nat¬ 
ural language known as English. As a consequence of the 
relationship between the concept of complexity and scien¬ 
tific modeling, it becomes critical to consider what are the 
circumstances that transform the latter into the former - 
i.e. that makes scientific modeling a problem complex. 

The present didactic text aims are approaching com¬ 
plexity in an introductory and accessible manner, follow¬ 
ing the lines of though outlined above. We try to provide 
a brief review of some of the several attempts that have 
been proposed for defining complexity, and also present 
some considerations leading to a potentially different way 
of looking at and understanding complexity. 

2 Some Approaches to Complex¬ 
ity 

The fact that complexity has been a constant companion 
of humankind can be appreciated by the several old men¬ 
tioning of this term (e.g. Old Testament and da Vinci’s 
quotation at the beginning of the current didactic text). 
One important issue to be considered from the outset 
is that there are two aspects of complexity: (a) defini¬ 
tion; and (b) quantification. Often, these two aspects 
go together. In particular, if one is capable of measur¬ 
ing complexity, we can say simply that an entity with 
high complexity value is complex, while an entity with 
low complexity is mostly simple. Yet, some of the defini¬ 
tions of complexity are predominantly qualitative, such as 
the possibility that complexity starts form where human 
cognitive abilities end. In this section, we provide a brief 
review of some of the several approaches that have been 
advanced for quantifying (and therefore defining) com¬ 
plexity. It should be observed that this review is by no 
means completely comprehensive. 

(i) Informational Complexity: Deriving from ther¬ 
modynamics and information theory, the concept of en¬ 
tropy (e.g. a) allows an effective means for quantifying 
the amount of information (e.g. in bits) of a set or sym¬ 
bols. Let’s consider the Shannon entropy, given as 

S 

E =-^2,Pilog 2 {pi) ( 1 ) 

i=1 

where S is the number of involved symbols and pi their 
respective probabilities or relative frequencies. For in¬ 
stance, if we have a text containing 50 times the word 
‘tea’ and 50 times the word ‘time’ (observe that 5 = 2), 
we will need, in the average, 1 bit for representing the in¬ 


formation in this set. However, if we change the number 
of instances to 10 and 90, respectively, we have an average 
minimum of bits of only approximately 0.469. It can be 
verified that non-uniform relative frequencies of symbols 
lead to a reduction in the information content, and that 
maximum entropy is achieved whenever all probabilities 
are equal. The use the average minimum of bits provided 
by the entropy provides an interesting approach to quan¬ 
tify the complexity of an entity represented as a set of 
symbols, and can often lead to satisfactory results. How¬ 
ever, this approach does not consider the interrelationship 
between the involved symbols (other types of entropy can 
be used here) and, more importantly, a sequence of 5 sym¬ 
bols drawn with uniform probability will yield maximum 
entropy, while being statistically trivial (such sets can be 
obtained by sampling the uniform distribution, one of the 
simplest statistic procedures). 

(ii) Geometrical Complexity: Perhaps as a conse¬ 
quence of being more directly perceived, the complexity 
of patterns and shapes has attracted great attention from 
the scientific community. While a dot and a straight line 
exhibit minimal complexity, structures such as the border 
of islands, snowflakes and some types of leaves are char¬ 
acterized by intricate structures. Several approaches have 
been proposed for characterizing geometrical complexity, 
especially the concepts of fractal dimension (e.g- 0) and 
lacunarity (e.g. i). Briefly speaking, fractal objects ex¬ 
hibit self-affine structure extending over all spatial scales, 
therefore imparting high levels of complexity to such ob¬ 
jects. The concept of lacunarity, which was proposed by 
B. Mandelbrot in order to complement the fractal char¬ 
acterization of objects, expresses the degree of positional 
invariance of an object while observed at varying spatial 
scales (e.g. 0). 

(iii) Computational Complexity: One of the in¬ 

teresting approaches that have been developed to define 
and characterize complexity involves the concept of com¬ 
putational complexity (e.g. [7]). Given a specific oper¬ 

ation, the respective order of complexity quantifies the 
amount of computational resources (typically processing 
time and/or memory capacity) required for its effective 
calculation. For example, adding two vectors containing 
N elements each is characterized by computational com¬ 
plexity order of O(N), where OQ stands for the ‘big O’ 
notation. In this particular example, it is meant that 
adding the two vectors will involve a number of additions 
proportional to N. Observe that there are some intrica¬ 
cies in determining the OQ. For instance, adding three 
vectors with N elements each will imply 2N additions, 
but we still get the same 0(N ) for this case. It is not of¬ 
ten easy to calculate the OQ of a given operation, and the 
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reader is referred to the respective literature for more in¬ 
formation on this important and interesting area (e.g. H)- 
While the order of complexity provides a formal way to 
quantify some aspect of the complexity of an operation, 
it does cannot be directly applied to characterizing the 
complexity of entities and it may not be known or deter¬ 
minable in certain situations. 

(iv) Dynamical Systems Complexity: The area of 
dynamical systems has been extensively (e.g. [51 [HI O ) de¬ 
veloped in order to represent the interaction along time 
between the components of a given system. Examples of 
this approach includes population models (such as the lo¬ 
gistic approach), and the behavior of oscillators such as 
a pendulum. Though linear dynamical systems are rela¬ 
tively simple, non-linear counterparts can exhibit surpris¬ 
ing dynamic characteristics, such as the fact that small 
perturbations in the system input can induce large varia¬ 
tions of the respective output, a phenomenon that is asso¬ 
ciated to chaotic behavior. Non-linear systems can have 
rather complex attractors, such as fractals, so it makes 
sense to speak of the complexity of a dynamics in terms 
of the complexity of its respective attractor. However, 
maximum unpredictability and disorder does not, as a ne¬ 
cessity, means high complexity (we have already seen that 
numbers drawn with uniform probability are easy to un¬ 
derstand and model from the statistical point of view). A 
particularly enticing related idea is that complexity would 
take place somehow at the mid term between simple, pre¬ 
dictable dynamics and the highly unpredictable chaotic 
states. So, complexity would be mostly found at the bor¬ 
der of chaos (e.g. 0i). 

(v) Minimum Description Size (Kolmogorov 
Complexity): Another interesting approach at defin¬ 
ing/quantifying complexity considers the size or length 
of the minimal description of an entity. More formally, 
as originally proposed, this measurement takes into ac¬ 
count the coding of an operation in terms of a program 
of a Turing machine. The latter is an abstract, univer¬ 
sal type of computing engine in which symbols are stored 
in an infinite tape that can be scanned by a head capa¬ 
ble of performing some basic operations, involving some 
other components such as state registers. The Turing ma¬ 
chine is often considered because it represents a universal 
model of computing, but the quantification of description 
complexity can also be approached by considering other, 
more generally known, programming languages, such as 
C or Phython. Thus, given an entity (e.g. our emphati¬ 
cally welcoming text), we need to find the shortest pro¬ 
gram that can reproduce it. The complexity of that entity 
could then be gauged in terms of the length of the respec¬ 
tive code (e.g. number of instructions). Let’s consider the 


case of the emphatically welcoming text used in our Intro¬ 
duction section. Here, it would be very easy to obtain an 
extremely short program that produces that text. Such a 
program, in Python, could be given as 

for i in range (0,1000000): 

print ( ’hello ’) 

Though representing an interesting approach to quan¬ 
tifying complexity, the minimum description depends in¬ 
trinsically on the sequential type of type of coding and ex¬ 
ecution implied by the Turing machine. There are, how¬ 
ever, many different computational paradigms, such as 
recursive (e.g. LISP) and parallcl/distributed, that could 
be taken into account instead of the relatively abstract 
Turing machine. Even non-electronic means, biological, 
quantum, or even natural languages could be considered, 
implied in completely different programming and storage 
organizations. A same operation, when programmed in 
such different computing systems, would imply in largely 
varying minimum description sizes. An additional diffi¬ 
culty is that it is often a challenge to find the minimum 
code capable of reproducing an entity or phenomenon. 

(vi) Bennett’s Logical Depth: This method can 
be understood 32] as a combination of the computational 
complexity and minimum description size approaches. 
More specifically, it corresponds to the computational ex¬ 
penses required for performing the minimal code obtained 
for reproducing the entity or phenomenon of interest. As 
such, this method focuses on the computational efforts re¬ 
quired to reproduce a phenomenon. Though intrinsically 
interesting and with good potential, being useful in sev¬ 
eral situations and problems, this approach in some sense 
inherits the intrinsic limitations of the two approaches 
which it incorporates. For instance, if we considered the 
complexity order of the simple program we derived for 
producing the emphatically welcoming text containing N 
identical ‘helloes’, we would obtain 0(N ), suggesting a 
large complexity for that simple text. 

(vii) Network Complexity: With the impressive de¬ 
velopment of the area of Network Science, aimed at study¬ 
ing complex networks, the concept of complexity became 
related to the structure of networks used to represent a 
given entity or phenomenon. One of the reasons for the 
importance of network science is the capacity of a graph 
or network to represent virtually any discrete system. For 
instance, networks can be used to represent not only en¬ 
tities (e.g. airport routes), but also procedures in terms 
of semantic networks (e.g. my The complexity of a net¬ 
work is related to the degree in which its topology departs 
from uniformly random networks (e.g. HU)- Generally 
speaking, a complex network tend to exhibit a non-trivial 
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topology of interconnections. Such heterogeneities have 
to do not only with the node degree distribution, but 
also many other topological features of the studied net¬ 
works m- An interesting and not often realized issue is 
that most of interactions in the physical world take place 
through fields which, by decaying asymptoticaly, extend 
up to the end of the universe, implying most objects to 
be influence one another (see also Bell’s theorem my 

(viii) Interpretation and Descriptive Complex¬ 
ity: Lofgren m m describes an interesting approach 
to complexity involving the mapping from the system 
of interest into its respective description through learn¬ 
ing, while the inverse mapping is understood as inter¬ 
pretation j2|. This concept is combined with computa¬ 
tional and description complexity, and a basic language is 
adopted to model the proposed framework. An alterna¬ 
tive language-based approach to complexity has also been 
proposed in [2]. 


3 A Cost Approach to Complexity 

In the previous section, we briefly reviewed some of the 
several approaches at defining and quantifying complex¬ 
ity. Now, we aim at integrating several of the elements 
adopted in those approaches into an integrated, alter¬ 
native characterization of complexity that also involves 
additional elements and considerations. All in all, the 
main aspects of the proposed approach include: (a) re¬ 
lating complexity to scientific modeling, in the sense that 
the given entity whose complexity is to be measured is 
mapped from its specific domain into a respective de¬ 
scription (or model) in another domain (incorporating the 
mapping aspects from the Interpretation and Descriptive 
Complexity ); (b) considering the non-bijective nature of¬ 
ten characterizing such mappings, which implies in diffi¬ 
culties to recover/predict the original entity (a problem 
often studied in pattern recognition and computer vision, 
e.g. my w representing both the original object and 
its respective description in terms of graphs/networks; 
(d) associating costs (e.g. computational, economical or 
taken for developing the model) to the mapping and the 
error incurred in recovering the original entity from its de¬ 
scription; (e) relating the mapping cost to the complexity 
of the network representing the original entity; and (f) as¬ 
sociating the cost implied by the reconstruction error to 
some distance A between this reconstruction and the orig¬ 
inal entity. All in all, it is assumed that higher the costs 
imply in higher complexity, and vice-versa. It should be 
observed that the henceforth developed approach, we are 
focusing on the general concept of complexity as under¬ 
stood by humans. 


Figure[2]illustrates the above aspect (a). Here, we have 
an entity in its original Domain A mapped by an applica¬ 
tion / into a respective description contained in Domain 
B. For instance, Domain A could be nature, while Do¬ 
main B would represent the set of mathematical/compu- 
tational modeling approaches to be considered. Observe 
that, usually, the Domain B is more restricted than the 
Domain A, inherently implying the models to be incom¬ 
plete. In the present example, a physical cyan disk is 
mapped into its linguistic description. In case the inverse 
mapping / -1 exists, it can be used to recover the original 
entity without any error. However, this will not happen if 
Domain A is the real world, as there are virtually infinite 
possibilities of cyan disks (e.g. varying in color slightly, or 
presenting different radius). The simple framework illus¬ 
trated in [2] can be understood as the scientific modeling 
of the original entity (which can also be a set of entities, 
a dynamical phenomenon, etc.), therefore incorporating 
the aspects (a) and (b) listed above. This conceptualiza¬ 
tion is particularly helpful because it highlights the im¬ 
portance of the error in recovering of the original entity, 
which suggests that complexity would be related not only 
to developing a proper mapping / and its inverse, but also 
being dependent on the recovery error. In other words, 
larger reconstruction errors can be understood as indica¬ 
tives of the difficulty/complexity of modeling the original 
entity, which is defined both by the intrinsic features of 
the entity, the distribution of similar entities in Domain 
A (the larger this number, the higher the chances of hav¬ 
ing a non-bijective mapping), as well as the power of the 
concepts and methods available in Domain B. 






f 


M - 


"a cyan disk" 

entity 

f 1 

description 



DOMAIN B 


DOMAIN A 


Figure 2: The modeling of an entity understood as a mapping / from 
a domain A (e.g. nature) into a respective description in domain B 
(e.g. English language). In case the mapping is one-to-one (bijective), 
the original entity can be univocally recovered through the respective 
inverse mapping / -1 . This is unlikely to occur in the real world, because 
there is a virtually infinite number of possible cyan disks, so that the 
inverse mapping will be one-to-many (therefore non-bijective). 


We have so far taken the entity as a single object in 
Domain A. However, most of such objects can be un¬ 
derstood as sets of components interconnected by some 
relationships. By considering resources such as seman- 
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tic networks and Petri nets, it is even possible to rep¬ 
resent operations, procedures and programs as (e.g. net¬ 
works Mm)- Figure [3] illustrates a new instance of the 
framework in Figure [2} but now both the original entity 
and its description are represented as graphs/networks. 
An immediate advantage of this approach is that some of 
the reasons for / being non-bijective become evident: the 
potential complexity of the entities are revealed by the 
intricacy of the respective graphs. In addition, entities 
having similar network representations (e.g. differing by 
some missing connections or nodes), can be mapped into 
the same description when / fails to take into account 
such differences. In the case of Figure [2j this is reflected 
by the mapping of the three instances of the considered 
entity into the same representation. Directly related to 
this multiple mapping is the fact that the network respec¬ 
tive to the description in the Domain B is less complete 
than the network representing the original entity - e.g. 
by having nodes with different properties (colors in the 
case of the example in this figure) and/or missing connec¬ 
tions or nodes. There are, however, other possible sources 
of imprecision in the mapping, such as those implied by 
incorrect assumptions in the model construction, or also 
the presence of noise and incompleteness in the observa¬ 
tions of the properties of the original entity. This can also 
imply in a less accurate and complete descriptions being 
obtained in Domain B. 



DOMAIN A 

Figure 3: Modeling an entity represented by a respective network into 
a respective description, also involving a network. Observe that the de¬ 
scription is incomplete and not fully accurate, implying in the mapping 
/ being non-bijective. Consequently, more than one entity in the Do¬ 
main A can be mapped into the same representation in the Domain B, 
implying a degeneration in the mapping. By imposing some additional 
restriction (e.g. regularization), it is possible to obtain a single inverse 
reconstruction (in this case, identified by the asterisk), whose error can 
be gauged by some distance between the reconstructed and original enti¬ 
ties. In case / is bijective, the mapping of the entity can be understood 
as being complete. The higher the cost of the mapping / and the error 
A, the more complex the original entity would be. 


For all the reasons discussed above, the mapping / can 


be imprecise and non-bijective, leading to errors in the 
reconstruction of the original entity from its description. 
In the case of / being non-bijective, the inverse mapping 
can result in more than one potential entity in Domain 
A, so that it is necessary to impose some restriction on 
the modeling (an approach knows as regularization El), 
so that one of the recovered instances can be selected as 
being, potentially, the most likely and accurate. Possible 
restrictions may include the expected number of nodes, 
edges, and/or other properties. In the case of the ex¬ 
ample in Figure [3j the chosen inverse mapping, selected 
by the set of restrictions R , is identified by an asterisk. 
The error A of the reconstruction can then be quantified 
by taking some distance between the original entity and 
the selected reconstruction. It seems reasonable to un¬ 
derstand more complex entities will lead to less accurate 
mappings and descriptions, ultimately implying in larger 
reconstruction errors A. This line of reasoning leads to a 
possible alternative definition of complexity as: 


complexity oc {cost(f) + cost (A)} 


( 2 ) 


In other words, the complexity of an entity would be 
related (not necessarily in the linear sense) to the sum 
of the cost of obtaining a putative mapping / and its 
inverse / -1 , as well as the cost associated to the error 
in the recovery (or prediction) of the original entity. In 
other words, we could consider a more general definition 
as: 


complexity = g(cost(f ), cost(A)) (3) 

meaning that the complexity of the original entity or 
phenomenon would be given by a function g() of the two 
considered costs. 

Usually, there is a relationship between these two costs, 
in the sense that if one invests more efforts into developing 
a more complete and accurate model, therefore increasing 
cost(f ), the error and associated cost cost( A) tend to be 
reduced. On the contrary, in case the model is developed 
more quick and carelessly, a larger error will be implied. 
So, there seems to be a kind of conservation of the sum 
(or perhas product) of the costs cost(f) and cost( A). 

Observe that the two involved costs can be defined in 
terms of several aspects, reflecting each specific model¬ 
ing problem. For instance, we can take into account, as 
costs, the times (computational or taken for development) 
required for observing/measuring the original entity, ob¬ 
taining/implementing /, obtaining its inverses, and cal¬ 
culating the errors. Alternatively, we could consider the 
computational complexity or the economical expenses re¬ 
quired for the modeling project (e.g. wages, resources, 
energy, etc.). A combination of these costs can also be 


5 








adopted. Interestingly, the choice of costs, and the costs 
themselves, can vary in time and space. For example, nu¬ 
merical computation was much more expensive and con¬ 
siderably less powerful in the 50’s or 60’s than it is to¬ 
day. In other words, what was complex in the past may 
have become simpler. Also, these costs tend to change 
with conceptual and methodological advances. Perhaps 
the consideration of such costs therefore provides this rel¬ 
ative quantification that would not be directly contained 
in a more abstract quantification of complexity. 

Regarding the cost to be associated with the recon¬ 
struction/prediction error, it seems to be reasonable to 
understand that it is related (not necessarily in the linear 
way) to the reconstruction error A, i.e.: 

cost(A) ex A. (4) 

In particular it is expected that the cost is zero when 
A is zero. 

An intrinsic feature of the described alternative ap¬ 
proach to quantifying complexity is that it would be more 
closely related to the conceptual way in which us, humans, 
intuitively tend to discern between complex and simple 
(at least in a more informal way). In other words, when 
we say that a given entity, task or phenomenon is difficult 
or complex, we are inherently considering, in a more pro¬ 
nounced way, the expenses required for its understanding 
(e.g. through modeling) instead of some more abstract 
quantification such as derived from entropy or description 
length (though these aspects are often considered by mod¬ 
elers). In fact, probably we also consider these concepts 
by taking into account our previous modeling experiences 
wth similar problems. The reported approach also tends 
to adapt to cost changes implied by scientific and tech¬ 
nological advances, as well as the resources allocated to 
each specific modeling project. 

Let’s now illustrate how this approach to complexity 
performs regarding some case examples. First, let’s go 
back to the text with N repetitions of the word ‘hello’. In 
this case, there are no links (interrelationships) between 
the words, so the cost of / depends only on visiting each 
of the N words to find that they are equal. However, this 
operation is very simple, so we have that cost(f) is low. 
As the description is exact, we have that A = 0, so that 
cost) A) = 0. The overall cost depends only on cost)/) 
being, therefore, very low, and so is the complexity. As 
a second example, let’s consider the situation where the 
text contains N numbers in arithmetic progression (e.g. 
{1,3, 5, 7,...}). Now, there is an order relationship be¬ 
tween the nodes, establishing a chained network. Identi¬ 
fying this relationship is more costly than finding that the 
numbers are equal, so we have that cost)/) is more sig¬ 
nificant now. As cost (A) is again null, we have that this 


text has a moderate complexity relatively to the previous 
example. As a third example, let’s take into account the 
modeling of a switch device used to control an industrial 
motor. The entity now involves not only the switch com¬ 
ponents, but also effects of temperature, pressure, wear 
from usage, vibrations, possibility of electrical arching, 
type of motor, among other things. So, there are not only 
many nodes, but also many links between these nodes, 
hence cost)/) is high. In addition, errors in the modeling 
can imply in a very high cost, so that cost)A) is also high. 
As a consequence, the overall error is very high, and so 
would be the associated overall complexity. 

The proposed approach to complexity also holds for 
other situations, such as in human appreciation of art 
works, such as a literary text. As one reads a romance, 
a model of the situation and facts being described is pro¬ 
gressively built in the mind of the reader. After having 
completed the reading, one tend to understand it as being 
complex in case the model construction required partic¬ 
ular effort, and also because it is difficult to remember 
the plot in a good level of detail. Interestingly, two differ¬ 
ent readers may differ in their appreciation of complexity. 
This may happen, for instance, when one of the readers 
has greater acquaintance with the subject of the romance 
(e.g. having familiarity with the age or place where the 
plot takes place, such as knowing about medieval history 
while reading Eco’s The Name of the Rose). In fact, as 
described in the present work, the proposed concept of 
cost-based complexity turns out to be intrinsically related 
to each human individual, being influenced by previous fa¬ 
miliarity with aspects of the entity being modeled, as well 
as the resources (e.g. time, equipment, funding, inspira¬ 
tion) available for the modeling. 

4 Concluding Remarks 

We have seen how complexity has been approached from 
several points of view, from entropy to description length. 
That a more complete understanding of complexity in¬ 
volves so many aspects is hardly surprising, given that 
complexity is not simple... So, we have seen complexity 
considered from the perspectives including data and cod¬ 
ing size/length, geometrical intricacy, critical divergence 
of dynamics, and network topology. Each of these ap¬ 
proaches offer its intrinsic contribution to better under¬ 
standing and quantifying complexity while studying an 
entity and/or dynamics. 

In addition to briefly reviewing some of the many in¬ 
sightful ways in which complexity has been characterized, 
we also tried to integrate several of the principles under¬ 
lying these approaches, as well as incorporate concepts 
from areas such as pattern recognition and network sci- 
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ence, into a more integrate model of complexity which 
is primarily based on the completeness of representations 
understood as mapping of an entity from a domain into 
another. In addition, concepts from scientific modeling, 
pattern recognition and network science were also inte¬ 
grated, giving rise to an approach in which the complex¬ 
ity of an entity can be understood in terms of the cost of 
obtaining a proper mapping and the cost implied by the 
almost unavoidable reconstruction errors. In the likely 
case that nature operates at minimal cost (i.e. by follow¬ 
ing the principle of least action), we could go back to da 
Vinci’s quotation at the beginning of this didactic text 
and to conclude that: (i) everything would indeed be per¬ 
fectly simple according to nature principles; and (ii) it will 
be very hard for humans to completely tame complexity, 
especially as a consequence of the myriad of non-trivial 
relationships required for deriving more accurate models, 
not to mention the fact that the domains in which the de¬ 
scriptions are derived are necessarily less complete than 
nature itself. 
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Costa’s Didactic Texts - CDTs 


This is a Costa’s Didactic Text (CDT). CDTs 
intend to be a halfway point between a formal sci¬ 
entific article and a dissemination text in the sense 
that they: (i) explain and illustrate concepts in a 
more informal, graphical and accessible way than 
the typical scientific article; and, at the same time, 
(ii) provide more in-depth mathematical develop¬ 
ments than a more traditional dissemination work. 

It is hoped that CDTs can also provide integration 
and new insights and analogies concerning the 
reported concepts and methods. We hope these 
characteristics will contribute to making CDTs 
interesting both to beginners as well as to more 
senior researchers. 

Though CDTs are intended primarily for those 
who have some preliminary experience in the 
covered concepts, they can also be useful as 
summary of main topics and concepts to be learnt 
by other readers interested in the respective CDT 
theme. 

Each CDT focuses on a few interrelated concepts. 
Though attempting to be relatively self-contained, 
CDTs also aim at being shorter than the more tra¬ 
ditional scholar article. Links to related material 
are provided in order to complement the covered 
subjects. 


References 

[1] F. Heylighen. What is complexity? http: // 
pespmcl.vub.ac.be/COMPLEXI.html, 1996. [Online; 
accessed 05-May-2019[. 

[2] Bruce Edmonds. What is complexity? - the philoso¬ 
phy of complexity per se with application to some ex¬ 
amples in evolution, http://cogprints.org/357/, 
07 1995. [Online; accessed 05-May-2019]. 

[3] P. Ferreira. Tracing complexity the¬ 
ory. web.mit.edu/esd.83/www/notebook/ 

ESD83-Complexity.doc, 2001. [Online; accessed 
05-May-2019]. 

[4] T. M. Cover and J. A. Thomas. Elements of Infor¬ 
mation Theory. Wiley-Interscience, 2006. 

[5] H.-O. Peitgen, H. Jurgens, and D. Saupe. Chaos and 
Fractals: New Frontiers of Science. Springer, 2004. 


7 






[6] E. Pandini, M. S. Barbosa, and L. da F. Costa. 
Self-referred approach to lacunatiry. Phys. Rev. E, 
1:016707, 2005. Pre-print at https://arxiv.org/ 
abs/cond-mat/0407079. Online; accessed 05-May- 
2019. 

[7] C. H. Papadimitriou. Computational Complexity. 
Pearson, 1993. 

[8] M. Waldrop. Complexity: The Emerging Science at 
the Edge of Order and Chaos. Simon and Schuster, 
1993. 

[9] S. Kauffman. At Home in the Universe: The Search 
for the Laws of Self-Organization and Complexity. 
Oxford University Press, 1996. 

[10] H. F. Arruda, C. H. Comin, and L. da F. 

Costa. Intelligent complex networks, 

https://www.researchgate.net/publication/ 
327879655_Intelligent_Complex_Networks ,2019. 
[Online; accessed 05-May-2019, accepted for EPJB 
with modifed title.]. 

[11] L. da F. Costa. What is a complex network? 
https://www.researchgate.net/publication/ 
324312765_What_is_a_Complex_Network_CDT-2 ) 
2018. [Online; accessed 05-May-2019]. 

[12] J. Bell. On the Einstein Podolsky Rosen paradox. 
Physics , 1:195-200, 1964. 

[13] L. Lofgren. On the formalization of learning and 
evolution. Logic, Methodology and the Philosophy of 
Science , 4, 1973. 

[14] L. Lofgren. Complexity of descriptions of systems: A 
foundational study. Inti. J. Gen. Systems, 3:197-214, 
2007. 

[15] A. M. Abidi, A. V. Griboi, and J. Paiki. Optimization 
Techniques in Computer Vision: Ill-posed problems 
and regularization. Springer, 2016. 

[16] J. L. Peterson. Petri Net Theory and the Modeling 
of Systems. Prentica Hall, 1981. 

[17] S. Lu and S. V. Pereverzev. Computational Complex¬ 
ity. De Gruyter, 2013. 



